Tagged “model evaluation”
Models
IBM Granite Switch 4.1 Puts Chat, Decisions and Speech Behind One Endpoint
IBM describes chat, decision adapters and speech transcription behind one endpoint, but publishes no request contract, pricing or latency figures. Here is what to test first.
Research
Leash Bio's Lab-in-the-Loop Case for Chemistry Agents
A Latent Space summary of Leash Bio's DEL data, agent sandbox and Hermes shortcut example raises sharp evaluation questions it doesn't yet answer.
Research
AlphaFold Was a Breakthrough, Not a Complete Account of Biology
A Latent Space panel with DeepMind and Biohub treats AlphaFold as a breakthrough, not the end of biological modeling. Here is what R&D teams can take from it.
Models
OrcaCyber Zero 1.5: What a 100% Cybench Score Actually Tells a Security Team
Orca reports 39 of 39 on Cybench and 23 of 24 on CVE-Bench, but the figures are vendor-reported and the method is thin. Here is how to turn them into a proper pilot.